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e They will reach the point of the singularity, where they 
correct their own defects and program themselves to 
produce superintelligent artificial agents that far surpass 
human capacities in virtually every cognitive domain. 


e Kurzweil (1999, 2011), and other futuroligists, postulate the 
inevitability of superintelligent artificial agents as the 
necessary result of the inexorable rate of progress in 
computational technology. 

e They cite Moore's law for the exponential growth in the 
processing power of computer chips as the analogical 
basis for this claim. 
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e A number of scientists (Häggström (2016)) and 
philosophers (Bostrom (2014)) adopt the idea of the 
singularity as the basis for claiming that strong Al may 
pose an existential threat to humanity. 


e They envisage the possibility that super intelligent artificial 
agents could function autonomously in pursuit of goals that 
lead them to subordinate or destroy the human species. 

e Advocates of this view maintain that the likelinood of the 
singularity, and of the threats that it will generate is 
significant to the point that this scenario constitutes a real 
and present danger that computer scientists, technologists, 
and public policy makers need to address now. 
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e To illustrate his concerns Bostrom (2014) suggests a case 
in which a super intelligent robotic agent is charged with 
the objective of optimising and maximising the production 
of paperclips. 

e Acting without additional constraints than those imposed 
by its task the robot progressively turns humans, the 
biospehere, and the entire solar system into material for 
efficiently producing a massive collection of paperclips. 

e Its actions are motivated not by hostility to people, but by 
the fact that it assigns them no value beyond an 
instrumental role in the performance of its task. 


Economic and Social Effects Conclusions 


Super 


r Al 


The Singularity Thesis 


Al and Moore’s Law 


e Progress in software development generally, and in Al in 
particular, does not follow the exponential tractory of the 
increase in processing power for hardware. 


Conclusions 


The Singularity Thesis Automatior Economic and Social Effects 


Al and Moore’s Law 


e Progress in software development generally, and in Al in 
particular, does not follow the exponential tractory of the 
increase in processing power for hardware. 

e When Allen and Greaves (2011) raised this objection to the 
singularity thesis Kurzweil (2011) replied by invoking the 
case of thermodynamic laws, which accurately predict the 
behaviour of collections of gas particles, despite the fact 
that the behaviour of each particle appears random. 


The Singularity Thesis Automatior Economi 


Al and Moore’s Law 


e Progress in software development generally, and in Al in 
particular, does not follow the exponential tractory of the 
increase in processing power for hardware. 


e When Allen and Greaves (2011) raised this objection to the 
singularity thesis Kurzweil (2011) replied by invoking the 
case of thermodynamic laws, which accurately predict the 
behaviour of collections of gas particles, despite the fact 
that the behaviour of each particle appears random. 

e The analogy is misplaced, as the conduct of groups of 
scientists is not more accessible to accurate prediction 
than that of the individual researchers in these groups. 
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require a high degree of volitional independence. 


Even assuming self-improvement over a range of cognitive 
functions, and the capacity to implement secondary goals, 
it is not clear how volitional independence will emerge. 


Bostrom’s paperclip golem is a fictional version of such an 
agent, but it is not obvious how Al systems, current or 
future, could generate one. 


But unless one can give a well motivated account of how 
an autonomous super intelligent agent could be created by 
technological means that are plausibly achievable, the 
fictional agent remains a work of imagination (like the 
original golem) rather than a genuine prospect. 
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neural networks has produced breakthroughs in a number 
of important areas in recent years. 


These include speech recognition, image identification, 
image description, diagnostics, and automatic driving. 


Unlike other machine learning methods deep learning 
involves self-correction through iterated training and 
development passes (using, for example, back 
propagation) . 

It also uses a set of domain general learning algorithms 
whose parameters are tuned to particular domains through 
training. 
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super intelligent agent. 


All current Al technology is entirely task driven, and lacking 
volition. 


It is not in any way obvious how even radical improvements 
or modifications of current systems could yield the sorts of 
agents that the singularity thesis assumes. 

So the realisation of such an agent would require an 
entirely different sort of Al technology than any that we 
have created, or could envisage now. 
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Kurzweill (1999, 2011) suggests that one way in which we 
might achieve the singularity is by mapping all of the neural 
connections of the human brain, and implementing an 
artificial version of this neural mechanism. 

But a full mapping of the brain will not, in itself, produce an 
understanding of how it works computationally. 


Even if it did, it is not obvious that constructing such a 
device will produce the sort of super intelligent artificial 
agent that he envisages. 

We have decoded the genomes of basic organisms, but we 
are far from reproducing their biological properties and 
patterns of behaviour through synthesized genes. 
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From Possibility to Risk Assessment 


It is certainly the case that the singularity, and malevolent 
super agents are logically possible events. 

Until detailed arguments are presented showing how such 
events would come about, they are not more than that. 
They join the ranks of other remotely possible, but unlikely 
occurrences, like the sudden appearance of black holes in 
the vicinity of the Earth, and extra-terrestrial invasion. 
When assessing the risks associated with possible events, 
we prioritise them according to the likelihood of these 
events taking place in the foreseeable future. 
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It is necessary to distinguish the prospect of malevolent 
super agents from the likelihood that an Al technology will 
cause unintended harm through faulty design. 

The latter is a very real concern, which requires constant 
attention. 

It is not specific to Al, or to computer technology. 

It attaches to every artefact, from simple tools and 
weapons to advanced communications systems. 

The more complex a system is, the more challenging is the 
task of filtering out its design faults. 
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In previous industrial revolutions the loss of employment in 
one domain was compensated for by the opening up of 
production and services in new areas. 

The future wave of automation may well be different in kind. 
It could spread through all areas of the economy, rendering 
human labour unnecessary across a wide range of 
domains. 

This may result in large scale unemployment as a 
permanent feature of a technologically advanced economy. 
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e If the small group of people who design, produce, and 
market Al driven robotic systems control production and 
services, then there will be a very sharp division of wealth 
between this technology sector and the rest of the 
population. 


e Labour will become an increasingly unreliable source of 
income, as the demand for it declines. 


e This situation will pose a serious threat to social cohesion. 
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It is unclear how even highly regulated free market 
economies, in their current form, can cope with the 
economic crises that pervasive automation may generate. 
Large scale unemployment will emerge as an instance of 
market failure, created by the very technology that drives 
the market itself. 


It is difficult to see how to solve this problem without public 


intervention to achieve wide spread redistribution of wealth. 


If this does turn out to be the case, an important question 
is whether redistribution should provide a guaranteed 
income, or subsidise employment in services for which the 
market does not provide adequate demand. 
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The emergence of super intelligent robotic agents that 
pose a threat to humanity may be a logical possibility, but it 
does not seem likely at any time in the foreseeable future. 
Current Al technology, and any technology derivable from 
it, do not support this scenario in any plausible way. 
Widespread automation in large sections of the economy 
does appear likely, and it carries with it serious economic 
and social problems. 

Public planning and intervention are urgently needed to 
deal with these issues. 


